a^ 



> 



0^ 



Ph' 



O 



s 



Completeness and confusion in the identification of 
Lyman-break galaxies 



Garret Cotter^, Toby Haynes^, Joanne C. Baker^'^, 
Michael E. Jones^, Richard Saunders'^ 



0> . 1 Astrophysics, Cavendish Laboratory, 

2> ■ Madingley Road, Cambridge, CBS OHE, UK 

2 Astronomy Department, University of California, 

Berkeley CA 94720, USA 



O ! Abstract. 

■>!::;j- I We have carried out a study to simulate distant clusters of galaxies 

in deep ground-based optical images. We find that when model galaxies 
are added to deep images obtained with the William Herschel Telescope, 
there is considerable scatter of the recovered galaxy colours away from 
{^' I the model values; this scatter is larger than that expected from photomet- 

f^ . ric errors and is significantly affected by confusion, due to ground-based 

^^ I seeing, between objects in the field. In typical conditions of ~ 1-arcsec 

seeing, the combination of confusion and incompleteness causes a consid- 
erable underestimation of the true surface density of z ~ 3 galaxies. 
We argue that the actual surface density of z r^ 3 galaxies may be sev- 
eral times greater than that estimated by previous ground-based studies, 
consistent with the surface density of such objects found in the HDF. 



1. Introduction 



^ ' The field of the of the z = 3.8 quasar pair PC1643-I-4631 A & B contains a 

Cosmic Microwave Background decrement (Jones et al. 1997) which may be 
the Sunyaev-Zel'dovich effect of a cluster of galaxies at z >> 1 (Saunders et 
al. 1997; Kneissl et al. 1998). In an attempt to detect such a cluster, we have 
carried out deep UGVRI imaging of the field. No cluster is immediately obvious 
in the images, so we carried out Monte-Carlo simulations to quantify our ability 
to detect a cluster of galaxies in our images (full details are given in Haynes et 
al. 1999 and Cotter et al. 1999). 

2. Model high-z cluster galaxies 

Model clusters were created using simulated colours of evolving galaxies in the 
redshift range < z < 4, and added to our WHT images. We then used 
photometric redshift techniques to try to recover the simulated cluster. As the 
cluster redshift reached z ~ 1 and beyond, the lack of strong spectral features 
in the optical made the cluster increasingly difficult to detect. However, even at 
z ~ 3, where the characteristic Lyman-limit break became detectable, a large 
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Figure 1. Recovered UGR colours of simulated 2.5 < z < 3.5 cluster 
galaxies. All objects shown have measured R < 25.5 and G > 2a. The 
triangles denote l-cr lower limits in U—G. The crosses are stars from the Gunn 
& Stryker (1983) database and the dot-dash line is our bound for selecting 
z > 3 candidates. The tracks show the simulated galaxy colours at various 
redshifts; the point at C/ — G = 2.2 and G — R = 0.3 corresponds to z = 3.0, 
and points at larger U — G are at higher redshift in steps of Az = 0.1. Note 
that the recovered colours are skewed towards the red in G — i?. 



fraction of the the fake cluster galaxies were still recovered from the simulation 
with ambiguous colours (Fig 1). Indeed, in our z = 3.0 simulation, only one 
in five of the model cluster galaxies was identified as such by UGR selection. 
The recovered colours were skewed towards the red in G — R; this is a result of 
confusion with other objects in the field. 



3. Recovery of model z ?» 3 galaxies 

Our original search for z ~ 3 Lyman-break galaxies (LBGs) in these images 
(Cotter & Haynes 1998) had recovered a reasonable number of candidates — 
approximately 1.1 arcmin"^, similar to the findings of the surveys of Steidel et 
al. (1996,1998). The fact that our recovery of simulated high-z cluster galaxies 
was so inefficient therefore prompted us to measure the effects of completeness 
and confusion specifically for z ~ 3 galaxies. 

We ran 1000 simulations, each time adding ten fake LBGs to our images. 
Fake LBGs were drawn from a Schecter luminosity function with i?* = 24 and 
a = 1.06; all had input colours G — R = 2.2, U — G = 0.3. We used input 
half-light radii of 0.2-0.3" (Giavahsco et al. 1998). 

Then, using FOCAS, we attempted to recover the LBGs. Our selection 
criteria are chosen to be as close as possible to that of Steidel et al. We select 
only those galaxies clearly detected with R < 25.5 above the 3-0" isophote in R, 
measure magnitudes in U and G through this i?-band isophote, and then impose 



a colour cut ofU — G>2,U — G> 4(0 — R) + 0.5, which is closely equivalent to 
the "robust" colour selection of Steidel et al. First, we find that 53% of galaxies 
with input R < 25.5 are selected to the isophotal R = 25.5 limit. Second, we 
find that, as for our fake cluster galaxies, a large fraction of the fake LBGs are 
scattered far away from their input colours. 

In total, only 23% of the input LBGs with R < 25.5 remain within the 
z > 3 region of the UGR plane (Fig 2). Therefore, the true number of LEG 
candidates in our images may be four times greater than the 1.1 arcmin"^ we 
measure. Again we stress that, while our UGR filter set is slightly different from 
the UnGTZ used by Steidel et al., our search for genuine LEG candidates in these 
images finds a surface density at least as great as that of Steidel et al. 







Figure 2. Recovered colours of fake z = 3.0 LBGs; all have input colours 
G — R = 2.2, U — G = 0.3. All galaxies recovered to the R = 25.5 3-i7 isophote 
are shown; crosses mark those outside the z > 3 region of colour-colour space 
defined by the solid line ([/ - G > 2, C/ - G > 4(G - i?) + 0.5). Dots mark 
the 23% of the galaxies with input R < 25.5 remaining in the z > 3 region. 



These results suggest that ground-based UGR selection, while extremely 
successful at identifying z ^^ 3 galaxies, may miss a significant fraction of the 
population. This may have a bearing on the apparent discrepancy between the 
surface densities of LEGs measured in the Hubble Deep Field (HDF) and in 
ground-based surveys. There are 12 galaxies in the HDF which have spectro- 



scopic redshifts 2.8 < z < 3.5 and Vqqq < 25.5 (Dickinson 1997). These galaxies 
correspond to those which would be detected by the "robust" LBG candidate 
criteria of Steidel et al. (1998). However, one would expect, given the published 
surface-density of "robust" LBG candidates of ~ 0.7 arcniin"^ (Steidel et al. 
1998), to find only three such LBGs in the HDF. Of course, cosmic variance will 
be significant for the HDF; but it is striking that the apparent over density of 
LBGs in the HDF corresponds with our estimate of the fraction of LBGs lost to 
incompleteness and confusion in the ground-based images. 

4. Conclusions 

We have carried out simulations to examine the effectiveness of searches for 
high-redshift galaxies in deep optical images typical of those obtained with 4-m 
telescopes. We find that the scatter of the recovered colours of model galaxies 
away from their model colours is two to three times greater than that expected 
from the photometric errors alone and arises as a result of confusion between 
the simulated galaxies and the real objects in the field. Because of the effects of 
incompleteness and confusion, the surface densities of LBGs based on ground- 
based imaging may be underestimated by a factor of four; this is consistent with 
the surface density of LBGs measured in the HDF. 

To investigate these effects further, we will carry out more detailed simula- 
tions using our present data to investigate how the inferred luminosity function 
of the LBGs is affected by incompleteness and confusion. We also plan deep 
imaging programmes with the new generation of wider-field, high-image-quality 
instrumentation as it becomes available. 
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